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A fuitheWisadvaniage exists in thai, while a common look and feel may be 
available for programs implemented in a particular operating system or GUI system, this look and 
feel is generally not independent of the operating system or GUI system and thus the user must be 
retrained, to some extent, to use even the same program when it is mn on a different operating 
system or GUI system. 



A relatively recent development in user interfaces has been the adoption and 
acceptance of the world wide web and it's associate html-based browser paradigm. Despite 
limitations in early versions of html, the web browser paradigm is now widely employed and most 
users are familiar with it to some extent. Recent versions of hcml» especially dynamic html 
(DHTML), have removed some of the limitations of earlier versions, such as the requirement to 
employ java applets or to reload the entire page in order to update material on a web page. 
However, html-based browsers are still limited in the uses to which they can be put and They do not, 
by themselves, provide the services and feamres required to implement a GUI for an application 
program, especially not for an application program implemented in a component architecture. 



It is desired to have a user interface method and system which allows the web 
browser paradigm, or the Uke, to be employed as the GUI for application programs implemented 
with a component architectures. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a novel method and system for 
providing a graphical user interface for appHcation programs implemented with component 
architectures. 

According to a first aspect of the present invention, there is provided a system for 
providing a graphical user interface for a component based application program, comprising: 
at least one user interface component; 

at least one component of an application program, said component having a 
workflow defined for it, said workflow associated with one of said at least one user interface 
components; 
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ai least predefined user interface layout definitJ^uie arrangement of at least said 
at least one user interface component; 

a renderer to render a graphical user interface according to said at least one 
predefined user interface layout and a present context for said component based application 
5 program; and 

an application proxy to manage communication between said renderer, said at least 
one component of an application program and said at least one user interface component such that 
said graphical user interface is rendered upon a change in said present context. 

10 According to a second aspect of the present invention, there is provided a method of 

creating a graphical user interface for an application program implemented with a component 
architecture, comprising the steps of : 

(i) providing at least one apphcation program component, said component requiring 
at least one user interface component to be displayed in said graphical user interface In at least one 

15 context for said application program; 

(ii) defining a graphical user interface layout for at least said at least one application 
program component, said layout defining a position and arrangement for said required at least one 
user interface component in said at least one context; 



graphical user interface in accordance with said at least one layout defined for said context; and 



program changes, 

25 

The present invention allows new or different components to be added or employed 
with a component based application as desired. With the present invention, providing appropriate 
changes to the GUI of an application in accordance with the addition or alteration of components is 
easily accomplished. Also, particular components with Umited or special uses can be rented. 
30 Specifically, a DCOM or other component can be executed for a single use or for a predefined 
Umited time, via the internet or other teleconmaunications network. The present invention also 
allows the productization of components in a relatively simple manner. 



20 



(iii) instantiating said user interface component and associating it with said at least 
one application program component; 

(iv) determining the present context of said application program and rendering said 



(v) rerendering said graphical user interface each time the context of said apphcation 
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BRIEF DESCRIPTIOTTOF THE DRAWINGS 

Preferred embodiments of the present invention will now be described, by way of 
example only, with reference to the attached Figures, wherein: 



Figure 1 shows a conventional GUI for an application program, the GUI being 
5 implemented in Windows 98 ; 

Figure 2 shows a GUI for an application program in accordance with the preseni 
invention, the GUI being rendered by a DHTML browser; 



Figure 3 shows a schematic representation of the components of the GUI of Figure 



2; 



10 Figure 4 shows the GUI of Figure 2 when the application program is in a different 

concexi; 

Figure 3 shows the GUI of Figure 2 when the application program is in yet a 
different context; 

Figure 6 shows the GUI of Figure 2, with a different layout, when the application 
15 program is in yet another context; 

Figure 7 shows a block diagram of a GUI architecture, in accordance with an 
embodiment of the present invention; 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 shows the graphical user interface of the Microsoft Paint application 
20 program included with Windows 98, As shown, the graphical user interface 16 includes a graphic 
edit area 20, tool bars 24 and 28, and menu bar 32. Tool bars 24 and 28 can be dynamically 
updated, to display other tools as the context of the program is changed, for example by selecting a 
different tool. Typically, GUI's such as that shown in Figure 1 are specifically programmed for the 
operating system and/or programming tools employed. For example, GUI^s such as that shown in 
25 Figure I are commonly implemented within the framework provided by the Microsoft Foundation 
Classes (MFC) which employ various user interface functions provided within the Windows 98 
operating system. 



Once die GUI is iraplenciented, the display of the GUI to the user is accomplished by 



1 # 

n calung various operating system and/or GUI fi 



rhe application program calung various operating system and/or Gul functions to create the needed 
display objects. Like many such programs, the Paint program is monolithic and new capabilities or 
features can only be added by rewriting and recompiling at least a portion of the program. 



5 In contrast, Figure 2 shows a GUI 100 in accordance with the present invention. 

While the display of GUI 100 appears to be generally similar to that of Figure IJt is in fact 
constructed and displayed in a much different manner. Specifically, GUI 100 of Figure 2 has been 
rendered by a platform independent renderer, in this specific case, an DHTML browser, 

10 ' Figure 3 indicates the specific components of the GUI 100, which are arranged in 

frames within the DHTML browser. Frames 104, 108 and 112 include a variety of controls and 
other user interface components appropriate to the application program and it's present context. 
Frame 116 includes a docimient viewer and the DHTML browser itself includes a conventional 
^ menu bar 120- 

I .15 

In Figure 2, the application program is shown in an *'Edit Picture" mode. As the 
=P context of the application changes, one or more frames of GUI 100 are updated to display controls 

7^ and/or viewers appropriate to the new context and/or the layout of the GUI can be changed. For 

y example. Figure 4 shows a layout for GUI 100 as rendered for a "Special Effects" mode and Figure 

p 20 5 shows a layout for GUI 100 as rendered for a "Project Creation" mode. As will be apparent, in 
^ each case an appropriate set of controls and other user interface components and document viewer 

^ is rendered. Also, as shown the number, size and positioning of the frames rendered can be 

changed as the coniexi changes. For example, in Figure 5 an additional document viewer frame has 
been added down along the right hand side of GUI 100 and on which the images available within 
25 the project are displayed. 



If any particular context of the application program is best suited by a different 
layout, rather than merely by changing the number, size and positiotting of frames and/or the 
updating of appropriate sets of user interface tools which are used in one or more other contexts, 
30 the DHTML layout can be changed. Figure 6 shows an example of a Guided Activity context 



which has a significantl^ifferent layout to those shown in Figures 4 and 5. In chis context, a user 
who is less experienced is guided through the perfonnance of a selected action, such as the removal 
of blemishes from an inaage, while in the contexts of Figures 4 and 5, the experienced user is 
expected to operate tools, etc, without requiring such guidance. As will be apparent to those of 
skill in the an, the underlying components of the application program need not be changed if 
different layouts are employed. As will also be apparent to those of skill in the art, the decision to 
change layout or to update an existing layout for a context change is one which is subject to the 
skill and selection of the application progranmier. It is contemplated, for example, that in some 
circumstances wherein a layout for one context could merely be updated for another context, a 

programmer may decide to instead create a new layout. . 

i. 

Figure 7 shows a block diagram of the architectiue employed with the present 
invention to accomplish the rendering of the application program interface. While this particular 
architecture is presently preferred, it will be apparent to those of skill in the an that other 
architectures, embodying the same general principals, can also be employed if desired. The 
architecture shown in Figure 7 includes a renderer 200, which communicates with an application 
proxy 204, A set of presently instantiated user interface components 208 is provided, as is a set of 
presendy instantiated document viewers 212. As used herein, the term user interface is intended to 
comprise user interface components such as controls, display boxes, etc, and should not be 
confused with the application program components, also discussed herein. Funher, as used herein, 
the term "document viewer" is intended to comprise both the functions of displaying the current 
document is an appropriate format and a set of functions and methods appropriate that viewer. For 
example, an *'Edit Picture" viewer can include both the method of displaying a current version of an 
image and a set of edit methods including paint, erase, brush, undo and redo. 



The set of user interface components includes a persistent user interface component 
and the set of document viewers includes a persistent document viewer which are always 
instantiated to maintain communications between program components and to persist relevant 
information if no other user interface component or document viewer respectively is instantiated at 
any one time. This persistent user interface component and persistent docimient viewer are not 



rendered by rendeier 2' 




Application proxy 204 conmunicaies to Tenderer 200, lo user interface components 
208, 10 document viewers 212 and to a workflow manager 216, which implements each appropriate 
5 workflow, as selected by the user or otherwise specified. An active document manager 220 is 

responsible for handling communications between workflow manager 216 and ihe currently active 
one of the one or more documents 224 loaded into the application program. Each of these 
components is discussed below in more detail. 



10 The examples of the present invention shown in Figures 2 through 5 comprise a 

personal computer based photographic editing and compositing application program. As will be 
apparent to chose of skill in the an, the present invention is not so limited and other application 
^ programs can beneficially employ the present invention. For exampJe, desktop publishing, word 

;5 processing or htnaJ authoring application programs can employ the present invention and, in such 

lU 15 cases, appropriate sets of user interface components and document viewers will be provided, 
Q Further, while the embodiment of the present invention discussed below employs a DHTML 

^ browser as renderer 200, the present invention is not so limited and any appropriate tenderer can be 

^ employed. 

p 20 As mentioned above, xn a current embodiment of the present invention renderer 200 

^ is a DHTML browser. Renderer 200 includes a set of layouts which are therefore stored as 

^ DHTML pages defined for the underlying application program, each layout defining a respective 

GUI organization for a context of the application program. One reason that a DHTML browser is 
presently preferred to be employed as renderer 200, is that the rich layout feamre set of DHTML 
25 browsers allows elegant and efficient GUIs to be constructed. Further, sophisticated tools for 
creating such layouts are readily available. 
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Also, platform independence of at least the GUI can be achieved, provided that a 
suitable DHTML browser is available for each platform of interest. This would allow application 
programs implemented in a client-server arrangement or with DCOM or DCOM-like components 



5nn from a GUI being executed on anoBier 



to be executed on one pHlTonn from a GUI being executed on anoBIer platform. If the application 
program components are implemented in Java, or in another platform independent manner, 
platforai independence of the entire application program and its GUI can also be achieved. 



5 Application proxy 204 serves as the commimicaiion conduit between i-enderer 200 

and the components of the application program. To renderer 200, application proxy 204 appears as 
a single, monolithic application program and all details of the components which make up the 
application program are essentially hidden from renderer 200 which need only interface to 
application proxy 204. This also allows other components of the application program to be 
10 modified in fi manner which is transparent to the renderer. For example, an improved **Edir 

Picture" document viewer can be substituted in the application program. In this case, renderer 200 
will interact with application proxy 204 to render the GUI in the Edit Piciure context in the same 
manner as with the original version of the *'Edit Picture" document viewer as the interface between 
renderer 200 and application proxy 204 does not change. 
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In embodiments of the present invention wherein renderer 200 is a DHTML 
browser, application proxy 204 is implemented as a persistent frame, which is not visible to the 
user, which contains the dynamic link library or other components that implement the application 
proxy and which can contain any global values or settings employed by renderer 200. 



In addition to renderer 200, application proxy 204 also commuiucates with user 
interface components 208. These components, which can include controls such as button, sliders, 
radio bunons, edit boxes, etc., can be implemented in a variety of manners, including as ActiveX 
controls, Java applets, etc. Application proxy 204 also communicates with document viewers 212 
25 which will include viewers appropriate to observe and interact with data appropriate to the 

application program, in all of its possible contexts. For example, in the illustrated photographic 
editing and compositing program, document viewers 212 include an "Edit Picture" viewer, a 
"Special Effects" viewer, an "Object Manager"' viewer, etc. 
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Each viewer 212 has one or more workflows defined for it. These workflows, which 



iaoies and states that are required to be shared ai 



comprise methods, variaBies and states that are required to be shared among program components 
and can include, for example: zoom; undo; redo; brush; size; text operations; etc. and also allows 
various user interface components to be registered with the workflow and can define default values 
and/or conditions for the workflow. For example, in the case of a zoom workflow, the user 
5 interface components associated with the workflow can comprise: a text box (to display the current 
zoom percentage); a slider (to select the desired zoom percentage); and a default zoom value of one 
hundred percent. 

The management of workflows is performed by workflow manager 216. As a 
10 document viewer 212 is instantiated, it's associated workflows are registered with workflow 

manager 216. Workflow manager 216 manages communication between document viewers 212, 
user interface components 208 and, through application proxy 204, with Tenderer 200. Each user 
interface component 208 for a workflow registers itself with workflow manager 216, as the user 
interface component is instantiated, to identify the variables it is interested in or deregisters itself 
15 with the workflow manager as it is destroyed. For example, a Zoom slider would register that it is 
interested in a variable "20om" and will send it messages to that variable if the user interacts with 
the slider. Further, the workflow manager ensures that the zoom slider receives any updates to the 
variable "zoom" which have resulted from any changes to the variable from other sources. 

20 Workflow manager 216 also interfaces with active document manager 220 to 

retrieve and/or to write information to the current active document 224 as required by a workflow. 
This can include the initial reading of the present active document into the application program for 
display in a document viewer 212 or the writing of a changed version of the document, as produced 
by a document viewer 2 12, or the writing of an undo file for the present active document. 

25 

The onler in which a workflow is defined is not fixed. For example, if renderer 200 
has a layout defined which includes a set of user interface components 208 for a zoom control and a 
document viewer 212 is loaded for which a zoom workflow is not defined, the set of user interface 
components 208 register themselves with workflow manager 216 and are displayed in an 
30 inoperative or '^ghosted** manner by workflow manager 216 as it can not relate them to a variable 
defined for docmnent viewer 212, When a document viewer 212 is subsequently loaded that has a 



zoom workflow and/or variable defined, the zoom workflow is registered with workflow manager 
216 and marched to the associated set of user interface components 208 and variables which are 
then shown as being active or un-ghosted. In the more usual circumstance, loading a document 
viewer 212 will result in an update and re-rendering of the user interface layout by renderer 200, the 
update changing the user interface components 208 in the layout as required. 



While workflow manager 216 primarily communicates with application proxy 204. 
for efficiency workflow manager 216 can communicate directly with user interface components 208 
and with document viewers 212, For example, a user can activate a load new image control, in user 
interface confiponents 208, which requires the loading of an entire image. User interf'ace 
components 208 can pass the appropriate message to workflow manager 216 which in turn obtains 
the document information from the active document 224 via active document manager 220 and 
forwards the document information directly to docunaent viewer 212. 



In addition to changes to the active document, active document manager 220 is also 
responsible for writing or otherwise persisting information relating to the present state and context 
of the application program relative to the active document. For example, if the docamem is being 
viewed in a document viewer 212 at a zoom setting of two hundred percent, this setting is stored by 
active document manager 220 with the active document 224 for that context. If a context change 
occurs in the application, for example in response to a user interface event, and a different 
document viewer is loaded where zoom is not provided and another context change subsequently 
occurs loading a document viewer where zoom is provided, active document 224 will be displayed 
at the previously set zoom of two hundred percent by recovering the stored zoom rate infomiation. 

When a context change, or other event requiring a display update, occurs within the 
application program, either as a result of a user interface event or another event, a message is sent 
by application proxy 204 to renderer 200. Application proxy 204 is responsible for determining 
the changes required to be made to the application program user interface, whether these changes 
require rendering of a new layout or the updating of the present layout. In response to the received 
message, renderer 200 will then re-render the application program user interface to dynamically 
update the display to reflect the changes indicated by application proxy 204 resulting from the 



:rTveni. When xenderer 200 re-renders the aoDli 



context change or other^veni. When renderer 200 re-renders the application program user, any 
updated elements are provided by workflow manager 216. These elements comprise the user 
interface components 208 defined for the present context, the docimieni viewer or viewers 212 
defined for the present context and the present active document 224. 



As mentioned above, application programs used with the present invention can be 
implemented with components, such as COM, DCOM or CORBA objects. Application proxy 204 
serves to marshal the information from each component of the application program to renderer 200, 
such that, to renderer 200, application proxy 204 appears as a monolithic application program. 

In the photographic editing and compositing example discussed herein, user 
interface components 208 are implemented as ActiveX controls or Java applets. Document viewers 
212 are also implemented as COM objects, each having at least one defined workflow which can be 
registered with workflow manager 216. as mentioned above. 



If renderer 200 is a DHTML browser, or the like, it is also possible to implement 
one or more or all of user interface components 208 in the DHTML layout, with Javascripts or the 
like, and a callback to application proxy 204 can be effected upon the defined user interface event 
occurring in the browser. These Javascript or other implemented controls can also be used to 
update ihe display produced by renderer 200, if desired, thus allowing the present invention to 
employ generic HTML-based controls and obviating the need to write custom ActiveX controls or 
the like. 

One of the advantages provided by component architecmres is that new or different 
components can be added or employed as desired. With the present invention, providing 
appropriate changes to the GUI of an application in accordance with the addition or alteration of 
components is easily accomplished. For example, if a new or enhanced document viewer 
conaponent is added to the photographic editing and compositing application discussed herein, the 
workflows associated with the document viewer are registered with workflow manager 216, using 
an appropriate workflow registration method. User interface components required by the document 
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viewer component are ii!5fantiated if necessary and registered with^orkflow manager 216 and 
appropriate default values or conditions (if any) are defined The new or enhanced document 
viewer component is then ready for use with the application program. As will be apparent, in most 
circumstances no new layout need be defined for renderer 200 as the layout will be re-rendered, as 
necessary, with the appropriate document viewer and user interface coraponenis as needed. If a 
new layout is desired, it can be provided with the component and provided lo renderer 200 as 
desired. This allows purchasers of the application program to purchase additional components, as 
needed. It is also contemplated that particular components with limited or special uses can be 
rented. Specifically, a DCOM or other component can be executed for a single use or for a 
predefined limited time, via the internet or other telecommunications network. 



Another advantage of the present invention is that it enables the productization of 
components in a relatively simple manner. Specifically, different products can be constmcted 
merely by changing the layout employed by renderer 200. For example, an expert product can have 
one layout wherein all available tools are displayed to the user, providing an efficient workspace, 
while a begiimer product can have one or more layouts of fewer tools each and arranged by task 
providing a simplified workspace, albeit a less efficient one. Further, the expert product can 
include various tools and capabilities in addition to those provided with the beginner tool merely by 
including additional components and an appropriate layout. The present invention thus encourages 
the construction and implementation of component based application programs. 



The above-described embodiments of the invention are intended to be examples of 
the present invention and alterations and modifications may be effected thereto, by those of skill in 
the art, without departing from the scope of the invention which is defined solely by the claims 
appended hereto. 



